OracleonNutanix(SETraining)

AlbertChen

APACSystemSpecialistEngineerBusinessCriticalApps

SolutionArchitect

Albert Chen / Nutanix APJ System Specialist -BCA

§ Certification

• ITILv2;HPUXSystemAdministrator;OracleOCP;

VMwareVCP3, 4,5;EMCTechnologyArchitectExpert;

EMCCACloudArchitectSpecialist,NutanixNPP

Certification,TTTCertification

§ Experience

• NutanixAPJSr.SystemEngineer2014 ~ Now

• VMwareGlobalCOE–Sr.SolutionArchitect2011

• EMCsolutionCenterPrincipleSolutionEngineer2004

• HPService–SoftwareEngineer2001

• SystexTechnicalEngineer1997

What are Business Critical Applications

Any application that could have a material impact on your or your

customers organizations' reputation, productivity or financial

viability if it were to become unavailable or experience severe

performance degradation for an extended period of time

Examples:

§ ERP systems and supporting databases and middleware

§ Manufacturing, Process Automation and Control Systems – SCADA

§ Financial systems, payment processing, online banking

§ Middleware and ESB systems

§ Billing systems

§ Customer facing online systems

§ What else?

• Generally

– Hardware or software refresh

– Uptime and compliance issues

– Mergers or rapid business transformation

• Exchange

– Exchange 2010 upgrade cycle (no in-place upgrade

from either 2003 or 2007)

– Issues with DAG or clustering

• SQL

– SQL version upgrade (e.g. 2005, 2008, 2012)

– Changing Microsoft licensing from Enterprise to

Datacenter

• SharePoint

– SharePoint version upgrade (e.g. 2007 to 2010)

– Migration from other collaboration

platforms/applications

• Oracle

– Creating cost-effective development and testing environments

quickly

– Underutilized Oracle database servers that need consolidation

• SAP

– New SAP install

– SAP upgrade cycle

– Migration to 64-bit NetWeaver

– New SAP modules (e.g. CRM, BW, SCM)

• Unix Migration

– Cost-cutting or end of mainframe lease

– Changing database platform (e.g. DB2 to Oracle)

• Java

– Scalability issues (e.g. parallelism or data latency)

– Application downtime due to frequent software and system

upgrades

When to Virtualize that App?

BusinessCriticalApplicationHighAvailability

• ProtectonCPU/Memory–

• ServersClustering–Protectonservicelevel

• HypervisorClustering–ProtectonVMlevel

• ProtectonStorage–

• DualController/DualFans/DualPDU

• RAID1/5/6

• HighAvailabilityalwaysmentionedRTO,RTOdecideyourdesign

• ApplicationLevel–ex:OracleRAC(RTO<fewseconds)

• OSLevel–ex:VeritasCluster(RTO<13minutes)

• HypervisorLevel–ex:vSphere,AHV(RTO<35minutes)

FieldPresales“asks”onOracledatabase

• CustomerrequiredsizingOraclefortheirenvironment,buthow?

• HaveaPOCrelatedtoOracledatabase,butdon’tknowwhatkindof

modelNutanixcanfitin?

• HowmanyOracledatabasesinonenodewillbethebestconsolidation

rate?

• HowrunningabestpracticedesignedOracledatabaseonNutanix?

• Whatkindoftoolsforperformancetesting?

• POCtestingstep&Scenarios?

Oracle101

• WearenottrainingeveryoneasaOracleDBA.Wejustgive

youideaaboutwhatthedatabasedoing,andwhatweneed

toknowrelatedtoNutanix

• Ifyouwantknowmore,youcanjointheirofficialtrainingor

moreselfstudy

Instance

OracleBasicInfrastructure

Storagestructures

Memorystructures

Processstructures

SystemGlobalArea(SGA)

Backgroundprocesses

Databasefiles

ClientProcesses

BufferCache

Share_

Pool

Data

Dirctionary

Large

Pool

OracleInstance/Database

• Instance

- SGA+BGProcesses

- SGA

Buffercache–Likeour“OPLOG”and“ContentCache”forwrite/readcacheusage

SharePool–SQLhashstore

DataDictionary–SystemObjectcache–like“MetaDataCache”forafilesystem

LargePool–forexport/import,backup…

- PGA:Processesworkingspace

• Database

- Agroupoffiles,WhererelatedtoIO

Whatkindofdatafiles?andfunctions

•Onlineredologfiles

•Passwordfile

•Parameterfile

•Archivelogfiles

Controlfiles

•Datafiles

•Alertandtracelogfiles

•Tempfiles

Group1

Group2

Group3

OracleFiles

• ControlfilesLogallOracleStructure(Howmanydatafiles,locations..)sometime

forbackupcataloguse

• Datafiles–Wherethetables,indexesinside

• Redolog–Wherelogalltheinsert,update,deletetransactionrecord

• Archivelog–Whenenabledarchivemode,willstartgenerate.Oldredologcopy

• Parameterfileplaintextorbinfiles(bydefaultafter9i),keepallparameter(ex:

SGAsize,Parallel..)

• TempfileWhensortingorjoinSQLstatementwillsave

• Alert/Tracelog–systemlog,findproblemuse

WhatrelatedtoNutanixIO?

• ControlfilesAlwaysreadwhenstartdatabase,writewhenbackup.Whendesign

wecanignorethelocationofthis.

• Datafile–

- Traditionalway,wewillaskseparatetablesandindexestablespacesintotwoLUNs.Best

practicenowusingASM.Willintroducelater

- OLTPalwaysrandomread/write,IOsizeusually8kbutcanchangeafter9i

• Redolog–Alwayssequencewritenoanyread.Butwhenenablearchivelog,will

startsequenceread.

• Archivelog–Alwayssequencewrite,Whenrecoverdatabase,startsequenceread

Logicalvs.PhysicalviewinOracle

Database

Logical Physical

Tablespace

Datafile

OSblock

Segment

Extent

Oracledata

block

Schema

RealFiles

8,16,32K

YoucanthinkSchemaisauser

Thinkisasatable/Indexusedspace

Oracle

ASM

TheOperationalStack

Disks

LogicalVol

FileSystem

00100010001000100010

Files

Tablespace

Tables

DiskGroup

LogicalVol

FileSystem

Files

Tablespace

Tables

OLDUNIXOracleDB

ASM

ASMBenefits

• What’sASM

• SpecialOracledatabaseinstance–StillaOracledatabase…..(YoucanthinklikeCVM)

• LikeVxVMvolumemanager

• Benefit

• Simplifiedmanagementinterfaceforstorageresources

• EliminatesmanualI/Operformancetuningtasks

• Virtualizesthestoragetoasetofdiskgroups

• Providesmainframeclassperformanceatlowercost

• What’sthedifferentcompareASMwithVxVM/LVM?

• KeyisASMwillloadbalanceontablespacelevel,VxVMorLVMnotjustPE(PhysicalExtent)level

OracleBackup/Restore

BackupMethod

• PhysicalDataProtection

• Coldbackup–shutdownalldatabase,copyallfilestootherlocation(impossibletocustomer)

• Export/ImportorDataPump–Justbackuppointintimedata

• HotBackup–UsingRMANbackuputilitytoTapeorDisk(Mostofuserwillusethisasabackup

methodofOracle)

• VMwareVADP(VMwarevStorageAPIforDataProtection)

• LogicalDataProtection

• Flashback–CanprotectinTransaction/Table/Wholedatabaselevel

• Needtoassign“FastRecoverArea”

• Likesnapshot…recovertopointintimewhendodatabaselevelrecover

RMANBackup

• RMAN–

- UsuallyusingcontrolfileoracatalogDBasabackupmetadb(oryoucanthinkitasIndex).

- Supportalldatabasebackup,incrementalbackup(Blockchangetrace)

- MostofthirdpartybackupsoftwarecallRMANscripttobackupOracleDB(Backupagent

issuescripts)

– ALLOCATECHANNELch00TYPE'SBT_TAPE’;

- Clonedatabaseonlinefordeveloporfordataguard

OracleDatabaseTraditionalInfrastructureLayout

OracleRACLUN

1TBx12

OracleRAC

VMDK

500GBX24

ESXiDatastore

1TBX12

OracleASMDG1

1TB

(redolog,temp

tablespace,controlfiles)

OracleArchiveLogDest

500GBperVM

OracleASMDG2

500GBx20=10TB

(tabledatafiles,index

datafiles)

YoustillneedtodecideLUNsRAIDType,ZoningandMasking

KeyQuestiontocustomer–

 HowmanyLUN/Datastorenow

youneedtomaintain?

Imageonedatabasewith10LUNsyou

have10database,youneedmaintain

100LUN,40Zoning,100masking

Ifdatabaserunoutspace,addextra

storageforspace…Complicate,Risk....

OracleDatabaseNutanixLayout–OurKeyBenefit

Container

OracleRAC

VMDK

500GBX24

Datastore

OracleASMDG1

1TB

(redolog,temp

tablespace,controlfiles)

OracleASMDG2

OracleASMDG3

500GBx20=10TB

(tabledatafiles,index

datafiles)

Noneedtodesign

KeyAnswertocustomers–

• Reducemaintaineffort

• Easytoextendspacewithoutdesign

andrisk

• AutomaticLoadbalanced

OracleRAC

ESXiHost1

ESXiHost2

Oracle

RAC1

Oracle

RAC2

Oracle

VMDK

(Shared)

EnableMultiwriter

• DesignKeyNote

• MultiWritermustenabled(ESXi)

• ThickEagerZeroformatforVMDK(ESXi)

• Interconnectenablejumboframe

• Interconnectusingvlan

• LeverageDRSaffinityrules

• AlwaysdesignasN+1

YourRTOdecideyourdesign

NX8235G4

NX3360G4

ESXi/AHV ESXi/AHV ESXi/AHV ESXi/AHV

ESXi/AHV

RAC1

RAC2

Oracle

Tier1Oracledatabase

Tier2/3Oracledatabase

OralceStandardEdition

RTO310minitus

OralceEnterpriseEditionwithRAC

RTO<1minutes

OracleRAC1&RAC2usingESXiDRS

AffinitylockinNX8235G4

Hypervisor

Tier2/3OracleusingESXiDRS

AffinitylockinNX3360G4

TraditionalITScalingMethod

100KIOPS

Performance

BusinessincreaseRequiredmoreservers

TheIOPSwillbecome200K?

DataMigration/Risk

NutanixScalingMethod

NDFS NDFS

Oracle

vMotionwithoutdowntime

Nodatamigration

Norisks!!

DatabasePerformanceonNutanix

NutanixABSScalesasyourBusinessGrows

CVM

New Node

CVM

Applicationneed90KIOPS

Whenbusinessgrowth–

Applicationneed120KIOPS

OracleLinux/OracleVMsupportNutanixABS

What’sthedifferentfromtraditionaliSCSIstorage

TraditionaliSCSI

• Providelimitedstoragecontroller

usuallyistwo

• Needconfiguremultiplepathand

assigncontrollers’ports

• TraditionalRAID–Whendisk

failedrebuildslow

• AddmoreLUNs,youneed

manualassignwhichcontrolleras

primaryandwhichissecondary

NutanixABS

• Provideunlimitedscaleoutstorage

controller(Performancecanscaleout)

• SingleDataServiceIP,donotneedto

assigntoeachcontrolleriSCSItargetport

• Distributedatatoothernodesprovide

RF=2,3protection.Ifnodefailed,westill

haveonecopyontheothernode

• Addmorevdisk,automaticloadbalance

inthebackend

HowtoperformaefficiencyPOC

What’sthesuccessfulcriteriaforanOraclePOC

• EngageProcesses–

• What’sthecustomer’sexpectation?Ex:Ineedachieve4000TPS

• Testingobjectives(HA,Functional,orPerformance)?

• HowlongforthisPOC?POCisnotQC.

• DowehaveabaselinecomparewiththisPOC?Comparewitholdsystemorsome

standardtestingtool?

• Whatweneedavoid–

• Usingwrongtestingtools–Ex:Storagevendersprovidedscript,singleSQLstatement,

batchjobexecutetime

• AskingforDataremodeling(Tablerepartition),DBA&Developersjobs

• AskingforSQLstatementreenforcement(RewriteSQL),DBA&Developersjobs

• Tables/Index/StoreProcedure..Storageobjectreconfigure

What’sthesuccessfulcriteriaforanOraclePOC

• Whatweneedprepared?

- Schedule,milestone,ownership

- Leverageapplications’venderssupport–Engageyourresources.Wecan’tdoeverything

- Correctsizing–ChoosetherightmodelforPOC.(Keyitem)

- Choosingrighttestingtools–Fair,QuicksetupPOCenvironment

- KeepPOCsimple–MostofdatabasePOCiscomplex,ifweinvolvetoomanydatabase

internalobjectlikeTables/Index/Procedure,SQLstatement…Wewillmakethingscomplex

- OLTP&OLAPtestingconfigurationaredifferent.Pleaseaskcustomerwhatkindoftesting

theywant

- Getthecurrentsysteminformationaspossible.Ex:OracleyouneedgetAWRreportif

possible.

WhatOracle/SQL/Mysqlperformancetoolsweuse?

• NutanixprovideXRayforOLTP&OLAPtesting–Wetalklater

• Oracle–

• BenchmarkFactoryhttp://software.dell.com/products/benchmarkfactory/need$$$

• **Swingbenchhttp://dominicgiles.com/swingbench.html(no$$$)

• HammerDB

• SQLServer

• BenchmarkFactory

• HammerDB

• SQLIO,Dskspeed(I/Oonly)

• MySQLServer

• Sysbench

• HammerDB

• BenchmarkFactory

X-Ray 2.0

• MusthaveNutanixloginaccount

• Downloadfromthe“Tools&Firmware

How to download X-Ray source

DownloadHere

Ifyoucan’tdownload,

pleaseaskfromyourregionchannelSE

Create X-Ray VM

ActuallyXRayisaovaorqcowfile

Youcanuseimageserviceuploadtoyour

Cluster.

Afterupload,youcancreateaXRayVM

Note:

RecommendinstallthisVM

outsidethetestingcluster

Test Scenario

UsingBrowserconnectto

http://yourxrayipaddress

Choose Hybrid/ All Flash Scenario

Whenchoosescenario,

Pleaseselecttheright

Testingmodel–Hybridor

Allflash

Add Target

IntheCreateTarget,meansaddatestingclusterinXRay

Choosethetypeofmanager,andclustertype.Givetheright

Informationasrequired

Result Analysis

AfterrunningXRay,itwillgivearesultanalysisandalsoshowyoutheperformanceresult

Result Analysis

Youcanexporttestingresultasazip

Orcreateareportforreading

OracleSizingandDesign

Correctsizingisveryimportant

DBAs

InfrastructureTeamMembers

Whenyousizingwronginthebeginning

Thenyouneedalltheexpertshelpyou

ButwemaynotrescueyoubecauseIt’s

Overload!!!

Customers

Physicalnodes

CustomerDatabase

CurrentStatusofOracleSizing

• WehaveSizeronNutanixwebsite–It’sthestandardof

Nutanixsizingmethodology

• https://services.nutanix.com

• SizerhadalreadycoveredmostofapplicationsbutnotOracle

database

• WeleverageSizer“Raw”inputmethodforsizingOracle

database

• InthefuturewillbehaveOraclesizingscenario

OracleSizingProcess

Collectperformance

datafromcustomer

site

AnalysisPerformance

WeatherReport

CPUConversion

MemoryCalculation/

IOPS/WSS

Assumption

SizerRAWdataInput

ConsideringHA/CPU

core/SDD

Conservative

ReportGeneration

PushBOMtoSFDC

VMlayoutonnodes

Collectperformancedatafromcustomersite

ConnectHQVPN,andlogintoMurali’sOracleAWRAnalyzer

Website

http://10.20.13.52:8080/RProject/index.html

Collectperformancedatafromcustomersite

Step1

• RequestthecustomertoruntheAWRCaptureSQLtocapturethedata.Runthese

onallDatabasesinscopeforsizing(atleastProductiondatabases).Scriptis

herecapture_awr_stats.sql

Step2

• Uploadtheoutputfileineitherawrhist*.outformatorazipfileformat(incaseof

multiplefiles).Sample.outfilecanbefoundhereawr-hist-2505896440-PPTL1-

7424-7627.out (Corp VPN is needed)

Step3-NutanixSE

• OnceyouuploadthefiletheparserwillparsetheoutputandgenerateaPDF

outputwhichyoucanuseforsizing.ItalsogeneratesanOverallSummary.csvin

caseyouareparsingmultipleoutputfilesatonce.SamplePDFhereAEBPD01-

40055-40852-1-plot.pdf

CollectionStep1

IfcustomerDBAcanhelpyoutocollectthatwillbegood,butif

customerdon’tknowhow,Pleasefollowthissteptocollect

data

1. Loginassysdbaordbaprivilege

• Loginoracleuser,inthecommandprompttype=>sqlplus/assysdbaorsqlplus

system/PASSWORD@SID

• sqlplus>@capture_awr_stats.sql(willrequireDiagnosticPacklics)askfor

customerdotheyhavethis.

• Inthesamefolder,willhaveoneoutoutlike“awrhist1423744458ORCL0

155.out”,where14237xxxxisDBID,ORCLisoracleinstance

Collection–Step2

Selectfilesanduploadawrhistxxx.outfile

Clickupload&parse

Collection–Step3

DownloadthePDFfile

AnalysisPerformanceWeatherReport(Section1)

Keymessages

• Node6meansOracleRACdatabase

• Platform–Linux

• Version11.2.0.3(patchesupdate3)

• Socket/coretotal12sockets/96cores,meansonenodewith16core(Wejust

watchingcorenumbers)

• Threads192means–Hyperthreadsenabled

• Memory256GBpernode–Totalmemoryofthismachineuse(notSGA)

• Daysshown28.8days–totalcollectAWRtimeis28.8days

AnalysisPerformanceWeatherReport(Section1)

Keymessages

• CPUMaximum98.1/Averageis41.5(Section2cansee)

• SGA+PGA=258+51=309GB,51pernode

• Databasesize=13624GB

AnalysisPerformanceWeatherReport(Section2)

AnalysisPerformanceWeatherReport(Section2)

Keymessages

• Rednumberforaveragevalues–CPU41.5average,ReadIOPS47782,WriteIOPS

4999.6

• Read/WriteRatio–47782/4999.6=9.5:1(OLAPdatabasepossible,butweneed

section3asaevidence)

• MaximumReadIOPS=89571,MaximumWriteIOPS=7872(Wewillbaseonit

whenwesizing)

•  

AnalysisPerformanceWeatherReport(Section3)

Keymessages

• Watchdailyoperationbehavior

• WriteisregularlythroughMondaytoFriday,andduringtheworkinghours

• Readispeakatnight,andhappendailyeveninSaturdayandSunday

• ThisdatabasecouldbeaOLTPandinnightwillbeaOLAPbehavior

CPUConversion

Scenario–

• CustomerI

– AlreadyuseX86serversbutstillinphysical

– AlreadyuseX86servers&virtualization

– WeuseSPEC2006

• CustomerII

– UsingoldUNIXserver,andwantconvertintovirtualization

– WeuseSAPs

– Reasonis,youcan’taskusertobuyaoldmachinetocompareUnixCPUtoIntelCPUhead

tohead.Wejustusethe3

partydatatocalculate

Customer I – Using SPEC CPU 2006

TheSPECCPU™2006benchmarkisSPEC'snextgeneration,

industrystandardized,CPUintensivebenchmarksuite,stressing

asystem'sprocessor,memorysubsystemandcompiler.

https://www.spec.org/cpu2006/results/cint2006.html

CustomerI–UsingSPECCPU2006

Example:

• ForthisOracleRACcustomerusingDellPowerEdgeR720IntelXeonE52603v21.8GHzCPU.The

Resultis29.4forsingletaskCPUperformance

• 

• ForNX8035G4,wepickSuperMicrowithsameCPUtype.IntelXeonE52660v3,TheResultis60.7

or60.8forsingletaskCPUperformance

• Sotherelativecomparisonwillbe60.8/29.4=2.06.ItmeansE52660v3almosttwicespeedsofE5

2603v2.

• Ifcustomerconvertfromphysicaltovirtual,therewillbeaoverheadforhypervisor.Wealways

assumeas10%ofthisconversionlost.Itmeans2.06X0.9=1.86.

Customer II – Using SAPs as calculation

TheSAPApplicationPerformanceStandard,knownasSAPSisa

unitofmeasurementthatdescribestheperformanceofaSAP

systemconfiguration.

• http://global.sap.com/solutions/benchmark/sd2tier.epx

Example:

• CustomeruseOracle10grunningonsolarisSPARC,UltraSPARCT2Pluswith32cores.TotalSAPSis

25830.Thenwecancalculatepercoreis25830/32=807SAPs.

• NowCustomerwantrunningonNX8150E52697v2CPU,theaverageSAPsis53702.EveryE52697

v2CPUhave24core,percoresapis53702/24=2237

• 

• DuetoVirtualizationwillhaveoverheadtoCPU,2237x0.9=2013.

• ThewecanassumeoneIntelE52697CPUequaltoUltraSPARC=2.49:1

CustomerII–UsingSAPsascalculation

Assumption

• Assumption

• ThismaynotgiveyouapreciselynumberoftheCPUconversionvalue.Butcan

giveyouarelativevaluebetweenthoseCPUmodel.

• WhenusingSAPstocalculate,weignorethebackenddatabasetype.

• AlltheSAPstestingisusing99%ofCPUutilization,Customer’sactual

utilizationwon’tnotsohigh.Ifwecangetcustomers’currentCPUutilization

calculation,thecalculationwillmoreprecisely.

• IfSAPscan’tfindaCPUtypelikeE52697v2,wecanpickoldonelikeE52660

v2andusingSPEC2006togetrelativecomparisonvalue

• **NotallCPUmodelcanbefoundinbothSPEC2006andSAPwebsite.Ifyou

can’tfindoneexactly.Choosethemostsimilarone

WSSCalculationorAssumptionRules

• Calculation–

– Choosethemaximumdeltasetx3asaWSS

• Assumption

– ForOLTPworkloads(<5TB)assume50%oftheDBsizeasworkingsetandincreaseto100%

dependingonhowbusythedatabaseis

– ForDWworkloads(>5TBSize)assume20%workingsetandincreasethenumberbasedon

customerdiscovery

IOPSCalculation

• UsingtheMaximumIOPSwecollectfromourscript(obsolete)

• WSS(WorkingSetSize)isthemostimportantinformationweneedtoget,but

inourscriptwecan’tgetthis

• WSSwilldecidetheSSDsizeinyourNutanixmodel

• InsomestoragelikeEMCVNX,VMAXcantrackingdeltablockchanged

• Ex:VNX–ReservedLUNPoolsusage

• ***WeassumedWSSforOLTPis30%ofalldatabase

Oursizingexample

• CPUcoretotal=96

• AssumeuseruseoldE52603andweconverttoE52660v2

• TotalIOPS=ReadIO(Max)+WriteIO(Max)

• 89571+7872=97443IOPS

• Totalcapacity1.3TBdatabaseusage(NotincludeVMGuestOSusage).

• TotalRAM=1151GBbyguesthosts,SGA+PGA=309GB

• WeassumetheOLTPWSSis30%,So13TBdatabasedata,wehave3.9TB

WWS.Actuallycolddatawillbe133.9=9.1TB

InputScenarioaswecollect

FromAWRanalysis

FromE52603toE52660v2

Shouldbeshrinkinourcase

Hot+ColdData

Recommendfordatabase

ChoosingRF,ErasureCoding

Createadedicatedclusterfortheworkload

Noprotectionconfigureinthiscase

Configuration1–Automatic

TCOcostsaving–71%

Configuration2Manual

TCOcostsaving–72%

Configuration3NX8035G5

TCOcostsaving–72%

Whichconfigurationisthebestone?

• FromROI/TCOperspective

• Configuration2&3savemoremoney

• FromHAperspective–

• Configuration1&2whenoneofthenodefailed,canprovidebetterresource

• Spendmoremoneyonlicensefee

• FromPerformanceperspective

• Configuration3providebestperformance(NUMAandlargeSSDspacetohold

moreWSS)

• ForAutomaticConfigurationisnotrecommendtouseinthis

scenario,weneedtobacktochecktheCPUconversionratio

BestPracticeforBusinessCriticalApplicationImportant

NutanixLayer

HypervisorLayer

GuestOSLayer

ApplicationLayer

WhenimplementBestPracticeforapplication

***Weneedtocheckalllayerconfiguration&

Parameterfollowbestpractice

Responsetime

Read the Best Practice then applied

BeforeBestPracticeApply AfterBestPracticeApply

Insamenode,Before&After

Design your critical database like “Partition”

2Socketwith40cores

192GBRAM

CVM

4cores/16GB

App1

8cores/32GB

App2

8cores/32GB

App3

16cores/96GB

App4

4cores/16GB

DedicateCPUcore/MemoryforT1Database

Dev/Testingcanbeovercommit

PhysicalMachine

VM1

ORACLE

CPUNUMAAlignementdesigninHypervisor

NutanixNode–2sockets,12physicalcores

vCPU-6

vCPU-3

VM2

ORACLE

VM3

ORACLE

vCPU-3

vCPU

Socket1(6cores)

C C

Socket2(6cores)

C C

CPUNUMARemoteAccess

Memory CPU CPU Memory

MemoryCtrl

Interconnect MemoryChannelMemoryChannel

LocalAccess RemoteAccess

CPU/NUMABestPractices

• AvoidRemoteNUMAaccess

• Size#ofvCPUstobe<=the#ofcoresonaNUMAnode(processorsocket)

• AlwayskeepHyperthreadson

• Initialconservativesizing:setvCPUsto#ofcores

• HTbenefitaround2025%insomescenarios

• IncreasevCPUstogetHTbenefit,butconsider“numa.vcpu.preferHT”option–

individualcasebasis

• DisableHotAddCPU

• AlignmentVMsvCPUwithinphysicalNUMAboundariesifpossible

MemorySizing

PGA

(Client sessions and context)

Oracle SGA

(DB buffer cache, and others)

Operating System

VMConfiguredMemory

• WhenwerunOracledatabaseinvirtualizationenvironment,weneedrightsizingofthoseVM

andreservedRAMforOracleDB

• SGA+PGA+BackgroundProcess+OS=ThatisreservationRAMsize

• Keep1:1rulesforOracle/SQLdatabase

Reservation

SGA/PGAsizeforanewproject

OLTP DSS(OLAP)

SGA_TARGET=(total_mem*0.8)*0.8,where

total_memisthetotalamountofphysical

memoryavailableonthesystem

SGA_TARGET=(total_mem*0.8)*0.5,where

total_memisthetotalamountofphysical

memoryavailableonthesystem

PGA_AGGREGATE_TARGET=(total_mem*0.8)

*0.2,wheretotal_memisthetotalamountof

physicalmemoryavailableonthesystem

PGA_AGGREGATE_TARGET=(total_mem*0.8)

*0.5,wheretotal_memisthetotalamountof

physicalmemoryavailableonthesystem

MemorySizingfromtheAWRreport–ExistSystem

Running AWR report

SQLPLUS> @?/rdbms/admin/awrrpt.sql

VirtualMemoryBestPractices

• ESXiMemoryManagementMechanisms

• PageSharing,Ballooning,MemoryCompression,SwaptoHostCache,RegularHostLevelSwapping

• MemoryReservation(ESXiOnly)

• AHVnomemoryovercommit

• setmemoryreservation=allocatedmemory(avoidballooning/swapping)

• useactivememorycounterwithcautionandalwaysconfirmedusagebycheckingmemorycounterinPerfmon

• DonotdisableBalloondriver,TransparentPageSharing(TPS)

andMemoryCompression(ESXiOnly)

• VMwareToolsmustinstalledintheguestOS

• Ifpossible,buylargeRAMmodelofNutanixtokeeptheconsolidationratio

higher

ASMLayoutforESXi

PVSCSI

vDISK1 vDISK2

vDISK3

vDISK4

vDISK5

vDISK6

vDISK7

vDISK8

VMwarePVSCSI

DiskGroup1

(Datafiles)

DiskGroup2

(RedoLog)

DiskGroup3

(ArchiveLog)

NDFS

ASMLayoutforAHV

vDISK1 vDISK2

vDISK3

vDISK4

vDISK5

vDISK6

vDISK7

vDISK8

Virtio

DiskGroup1

(Datafiles)

DiskGroup2

(RedoLog)

DiskGroup3

(ArchiveLog)

NDFS

VirtualSCSI

ThinorThickinvDisk?

• Wealwaysthinkthe“Thick”isbetterperformance?

• https://blogs.vmware.com/vsphere/2014/05/thickvsthindisksflash

arrays.html

• Notmuchinperformance

• OnlyneedwhenyouconfigureOracleRAC

• Butyouneedthink“SSD”isexpensivethan“HardDrive”

• Soyouneedsaveyour$$…thincansaveyourspace

• NutanixAHValwaysinthinmode

• Nutanixalsoprovidecompression,savemore!

OracleRAC–usingVMDKmultiwriterorusingABS

• WhenyouuseOracleRAConNutanix

• InESXi,youhavetwooptions.UsingVMware“multiwriter”parameterinyour

vDisk

• OrYoucanuseNutanixABSconfigure(iSCSIconnection)

• InAHV,youcanuseABS(Directconnection)or(iSCSIconnection)

• Whichoneperformanceisbetter?

OracleLayerBestPractice

• ConfigureOracleInitializationParameterParallel_Threads_per_CPU=1,and

DB_File_MultiBlock_Read_Count=128

• DisableOracleAMMAutomaticMemoryManagement

• SGA/PGAcorrectsizing

• UtilizemultipledisksforRedoLog,ArchiveLog,DatabaseTableSpaces

• UseOracleAutomaticStorageManagementifpossible,andsettheAUsize=1M

• EnableAutoExtendasafailsafeandsetnextsizetobeamultipleoftheASMAU

• ScalenumberofORADBVMsvs.largenumberofORADBinstancesandschemasperVM

• UseJumboFramesforOracleRACInterconnectNetworks

• UseVLAN’stoseparateOracleRACInterconnectTraffic

LinuxLayerBestPractice

• ReduceSwapping,usinghugepage,modifytheI/Oelevatorinthekernelbootparameter

• Go/etc/sysctl.confaddfewlineintheendofthisfile

• vm.overcommit_memory=1

• vm.dirty_background_ratio=5

• vm.dirty_ratio=15

• vm.dirty_expire_centisecs=500

• vm.dirty_writeback_centisecs=100

• vm.swappiness=0

• Aftermodifyalltheparameter,gocommandprompttype=>sysctl–p,rereadthesysctl.confand

takeeffective

• Alsofollowbestpracticeedit/etc/security/limit.conf

• NetworkingTuninginGuestOS(ESXionly)

• UsingESXiVMXNET3vNICandInstallVMwaretools

• Executecommand>/sbin/ethtoolGethXrx4096tx4096(Only)

HypervisorLayerBestPractice

• ClusterDesignusingN+1,nomatterESXiorAHV

• IfusepercentagevalueforHAadmissioncontrol=1/HostsperCluster(vSpherenoly)

• Ex:if4nodesincluster,setHAadmissioncontrol=25%

• KeeppCoretovCPU1:1forTier1,sometimescanbe1:2,dependsonyourdatabaseloading

• KeepNUMArule–KeepvCPUnumberseasilydivisiblebyNUMAnodesizesforeasyscheduling

• MemoryreservationfromHypervisorlevel(VMwareonly),AHVwillreserved

• VDSuseRouteBasedonPhysicalNICLoad,VSSRouteBasedonVirtualPortID(VMwareOnly)

• UsingPVSCSIandVMXNET3

• ESXiAdvanceparameter–

• NFS.ReceiveBufferSize=512

• NFS.SendBufferSize=512

• Net.TCPIPHeapMax=512

• UsingThickEagerZerodiskwhenOracleRACinconfiguration

Storage Best Practices

• Use multiple PVSCSI adapters to evenly distribute target devices

• Format database VMDK files as Eager Zeroed Thick for demanding

workload database

• Follow same guidelines as physical

– Separate vmdk with different IO characteristics i.e. datafile, log files, temporary

• Using Oracle ASM , otherwise make sure datafile size equally and load

balance them

• Disable Nutanix Shadow Clone Function

• Enable Container Level Compression

• Sizing Working set size correctly

100

UsingNutanixABSforOracleDB

• iSCSIparametermusttune

• node.session.cmds_max=2048

• node.session.queue_depth=1024

• node.session.iscsi.ImmediateData=Yes

• node.session.iscsi.FirstBurstLength=1048576

• node.session.iscsi.MaxBurstLength=16776192

• node.conn[0].iscsi.MaxRecvDataSegmentLength=1048576

• discovery.sendtargets.iscsi.MaxRecvDataSegmentLength=1048576

101

NetworkBestPractices

• SeparateinfrastructuretrafficfromVMtrafficforsecurityandisolation

• Using10Gb/sConnection

• Separatenetworkadaptersfor

– vMotion

– FTloggingtraffic

– ESXiconsoleaccessmanagement

– iSCSIusinginGuestiSCSI(SQL2008FCI)

• UseNICLoadbasedteamingfor(ESXionlyEnt+&VDS)

• UseVMXNET3Paravirtualizedadapterdriverstoincreaseperformance

(VMwaretoolsneeded)

102

NutanixLayerBestPractice

• UseasingleRF=2container

• KeepworkingsetinSSDanddatabasesizewithinnodecapacity

• ActiveWorkingSet=DatabaseBlocksReadPerDay+Database

BlocksChangedPerDay

• UtilizehighermemorynodemodelsforI/OheavyORADBworkloads

• KeepmostupdateNOSversion

• Alwaysturnoncompression(inlinecompression)

• Donotuseerasurecode,anddeduplication

103

InlineCompressionperformance

• Pleasereadthesearticle,wroteandtestbyJoshOdgers

• http://www.joshodgers.com/2017/08/02/thetruthaboutstoragebenchmarking/

• http://www.joshodgers.com/2017/02/15/whatistheperformanceimpactoverheadsofinlinecompressionon

nutanix/

104

Best Practice to Leverage

Oracle on Nutanix Papers

• Oracle Solution Brief

• Virtualizing Oracle with Web Scale Solution Note

• Oracle on Nutanix Best Practices Guide

• Oracle on AHV Best Practice Guide

Microsoft SQL Server on Nutanix Papers

• Microsoft SQL Server Solution Brief

• Virtualizing SQL Server on HCI Solution Note

• Microsoft SQL Server on Nutanix Best Practices

• Pleasecheckhere–

• http://www.nutanix.com/search/best+practice

105

MigrationOracletoNutanix

106

HypervisorSupportonNutanix–Oracle

Hypervisor GuestOSSupported Remarks/Notes

OnlyOracleLinux

107

DatabasemigrationScenario

• TypeI:UnixServertoNutanixPlatform(Oracle)

– RecreateOracledatabaseonNutanixPlatform

– Offline:DataPump

– NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck)

• TypeII:PhysicalX86toNutanixPlatform(Oracle,SQL)

– RecreateOracledatabaseonNutanixPlatform(Bestway)

– Offline:DataPump,VMwareConverter(NoneedrecreateVM),SQL Export/Import

– NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck) , SQL Mirroring

• TypeIII:ESXiX86toNutanixPlatformwith(Oracle/SQLonESXiServer)

– RecreateOracledatabaseonNutanixPlatform(Bestway)

– Offline:DataPump,NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck),StoragevMotion

• TypeIV:ESXiX86toNutanixPlatformwith(AcropolisHyperVisor)

– RecreateOracledatabaseonNutanixPlatform(Bestway)

– Offline:DataPump,NearOnline:OracleGoldenGate,DataGuard(OraclePlatformneedtocheck),StoragevMotion

108

OracleDRsolutiononNutanix

109

NutanixDRSolution(VMLevel)

DataCenterA

DataCenterB

ClusterA ClusterB

ESXiHost1

ESXiHost2

ESXiHost3

ESXiHost4

Oracle

VMDK

Oracle

VMDK

Replicated1hr/async

Primary Secondary

Cluster1

Oracle

ProtectionGroup

Cluster2

110

NutanixDR(VMLevel)

• Requirements

- TwoNutanixClusterineachsite,networkconnected

- Networkspeedwillinfectthesynchronizationschedule

- TwovCenterServersinbothsite

• Advantage

- SimpleconfigurationusingNutanixPrismandprovideVMlevelprotection

- SeamlessintegratedwithvSphereEnvironment

- NoanyOracleskillinvolve

- Provideblocklevelchange/compress/encryptiontransmit

- SynchronizationisdonebyNutanix,notvSphere

- Disadvantage

- TheRPOistoolongfordatabasesolution(1hr)

- DRbootupsequenceneedbescriptorbySRMintegrated

111

NutanixDRSolution(VMLevel–SRM)

DataCenterA

DataCenterB

ClusterA ClusterB

ESXiHost1

ESXiHost2

ESXiHost3

ESXiHost4

Oracle

VMDK

Oracle

VMDK

Replicated15mins/async

Primary Secondary

Cluster1

Oracle

vSphereReplication

Cluster2

SRM

112

NutanixDR(VMLevelSRM)

• Requirements

- Canbedifferentstoragesineachsite,networkconnected

- Networkspeedwillinfectthesynchronizationschedule

- TwovCenterServersinbothsite

• Advantage

- SeamlessintegratedwithvSphereEnvironment

- NoanyOracleskillinvolve

- Provideblocklevelchange/compress/encryptiontransmit

- TheRPOis(15minutes–minimumto1day),dependsonOracleSLAinTruecorp

- DRbootupsequenceintegratedbySRM

- SupportHeterogeneousStorageenvironment

- ProvideVMlevelprotectionifusingvSphereReplication

• Disadvantage

- SynchronizationisdonebyvSphere,notNutanix–meanstakeserver’sCPUcycle

- ComplexconfigurationinvSphereReplication(vSphereReplication,SRM,vCentersettings)

113

OracleHighAvailability&DisasterRecovery(cont’d)

Primary

Database

Standby

Database

SYNCorASYNCRedoShipping

UsingOracleNet

q OracleDataGuard

– Providesdataavailabilityandprotectioninasimple,fast,and

reliableonewayreplication

– FordatacenterDR

– DGisnotintendedtobeafullfeaturedreplicationsolution

– OracleGoldenGateistherecommendedsolutionforadvanced

replicationrequirementssuchasmultimasterreplication,granular

replicationofasubsetofadatabaseandmore

– CanbePhysicalorLogical

• Physicalstandbyisanexactblockforblockcopyofaprimary

database.UsesRedoApplyinwhichredodatareceivedfroma

primarydatabaseiscontinuouslyappliedtoaphysicalstandbyusing

databaserecoverymechanisms.

• Logicalstandbyisinitiallycreatedasanidenticalcopyoftheprimary

databasebutlatercanbealteredtohaveadifferentstructure.

Appliesinfofromarchived/redologsbytransformingthedatainthe

logfilesintoSQLstatementsandthenexecutingSQLstatementson

thelogicaldatabase.Canbeusedforqueriesandreportingatany

time.

– AdditionalcostforOraclelicenses

114

OracleHighAvailability&DisasterRecovery(cont’d)

UNIDIRECTIONAL

ReportingInstance

q OracleGoldenGate

– Enablesthecontinuous,realtimecapture,routing,

transformation,anddeliveryoftransactionaldataacross

heterogeneousenvironments.

– $$$

BI-DIRECTIONAL

InstantFailover

“Active-Active”

PEER-TO-PEER

LoadBalancing

HighAvailability

BROADCAST

DataDistribution

CONSOLIDATION

DataWarehouse/Mart/Store

CASCADINIG

Scalability,DatabaseTiering

117

PerformanceTroubleshooting

118

DatabaseResourcesConsumption

CPU Memory

Disk Network

Threads–Single,Multiple

ControlI/O,Netowork

IOPSOLTP

MB/sOLAP

BufferCacheData–HitRatio

CacheSQLcodeRepeatUse

SortArea

ClientConnectionWorkArea

SupportClientConnectionNumberofConnections

ReplicationAAG,DataGuard…

InternConnect–RAC

119

Slow–youcanfeel

WhenyouimproveyourCPUperformance

by100%Canyoufeelthat?No….

ButWhenyouimproveyourDiskIOperformance

by100%Youwillfeelit.

Ex:IhaveaHomePC,IupgradetheCPUmodel

orIreplaceanewSSDfromoldHDD?

Whatyouwillfeelworth?

120

DatabasePerformanceIssue(forSystemlevel)

• Findwhatyourapplicationconsume?

• CPU,Memory

• DiskIO

• Network

• Database(wewillnotcoverthislevel,that’sDBAshoulddothis!

• Datastructure(Table/Index)

• SQLstatement(Optimization,parse,executingplan)

• Databasewaits,lock,latch….

• Whencustomersaid–Myperformanceslow….What’sthefirstto

investigate?Answer:DiskIO

121

IdentifySingleThreadActivities

• IfSinglethread–YounevergetmoreIOPS.Howweidentifiedit’sa

singlethreadIO?

• DDisaverycommonexamplewhencustomerdoingperformancetest

• CheckNFSSlave“Avgoutstanding”

• https://portal.nutanix.com/#page/kbs/details?targetId=kA0600000008hMOCAY

OrinWindowstaskmanager,youalwayssee

122

Windowstaskmanager

SingleThreadRunningin

WindowsTaskManager

123

StargateComponentsAccess

FrontendAdapter(iSCSI/NFS)

AdmissionControl

vDiskController

ExtentStore

Oplog

ExtentCache(Nodedupe)

ContentCache(Dedupe)

StargateComponent

124

StargateComponents

• FrontendAdapter

• Receivesread/writerequestsfromthehypervisorhost

• AdmissionControl

• DetermineswhichrequeststoforwardtovDiskcontrollers,basedonthetypeofrequestand

numberofoutstandingrequestsinthepipeline

• vDiskController

• RespondstoincomingrequestsbasedonwhetheritisrandomorsequentialRandomIOissentto

theoplog.SequentialIOissenttotheextentstore.

• Oplog

• Receivesrandomwriterequests,whicharecopiedtoanoplogonanothernodeforhighavailability

125

StargateComponents

• ExtentStore

• Respondstorequestsbyreadingandwritingtothephysicaldisksonthenodeandsendsa

copytoanextentstoreonanothernodeforhighavailability

• ExtentCache(nodedupe)

• Holdsacopyofthemostrecentlyreturnedreadrequestsforcontainersconfiguredwithout

FingerprintonWrite(dedup)

Theextentcacheisstoredinmemory.

• ContentCache(dedupe)

• HoldsacopyofthemostrecentlyreturnedreadrequestsforcontainersconifiguredwithFingerprint

onWrite(dedup)

Thecontentcacheisstoredinmemoryandthemetadatadrive.

126

WhatweneedtocheckinstorageI/O?

Youneedtoinvestigatethosefirst–

• What’smydatabasesize?DomydatabasedataalwaysonSSD?

• CheckfromprismSeeifyourdatamostoftimeisinSSD

• Atleast50%ormoredatashouldbeonSSDex:youhave2TBdatabasebuyyoujustuse2x480GBSSD

nodetosupportit?

• Dowehaveenoughwritecache?

• NutanixusingOPLOGaswritecache–before4.5weusepervDisk2GBOPLOGlimitation,after4.6wehave

onevDisk6GBOPLOGlimitation.

• Checkfromprismport2009(stargatepage)seeifOPLOGfull.IfOPLOGfull,youneedaddmorevDisk

• IfaddmorevDisks,OPLOGstillfull.Youcanconsiderproposeallflashmodel.

127

WhatweneedtocheckinstorageI/O?

Youneedtoinvestigatethosefirst–

• CPUwaitIOtimeishigh?

• AlwaysCPUshouldbespendtimeforprocessapplicationnotforsystem%andwait%

• Using“Taskmanager”inWindowsor“Glances”,“Sar”..InLinuxtoidentiy

• WhereisheavyIOsource?Whoisthetroublemaker?

• SomebadSQLstatementconsumealltheIO?

• CreatesomeindextohelpreduceIOrequirement?

• ChecktheSQLexecutionplan?(MayneedDBAsupport)

128

WhatweneedtocheckinstorageI/O?

• Dowehaveenoughqueue?

• Whenmultipleconnections,oryoujusthaveonevDiskfordataaccessing,youalwaysgetthis

issue

• Alwaysyouwillseelatencyhigher

• CheckthequeuefromOSfirst,Hypervisorlevel,Storagelevel

129

StartOplogMonitoring

• TwomethodtocheckOplogusage–

• Enableport2009iniptables

- Shouldbeopennormally

- Ifnotopenport,pleaseusefollowcommendinCVM

- foriin`svmips`;dossh$i"sudoiptablestfilterAWORLDLISTptcpmtcpdport2009j

ACCEPT&&sudoiptablessave";done

- Connecttohttp://CVM:2009

• collect_perfthenuploadtoilluminatiAnalysisServer

130

Oplogmonitoring

• ChecktheOplogSize

• Before4.5oplogis2GB,afterNOS4.5oplogsizeperdiskis6GB

• Check“oplog”size,ifconsistencykeepinmaximum.Separatetomorevdisk.

• Avglatency(usec)alsoneedtocheck

• SomeGflagcantune

• stargate_prioritize_drain_on_oplog_pct_left=80(default35)

• stargate_vdisk_max_op_delay_secs=0(default5)

131

Oplogusagepage

132

ExtentCacheHitRatio

• http://CVM:2009/cache_stats

• AlwayskeepCacheHit%Higher

• Ifhitratioislow,increaseCVMmemorysize

133

ExtentStore

• It’sgoodplacetocheckdataisdraintoHDD

• IfmoreactivitiesarelocateintheHDD

• SSDcan’tholdthedataoverflow

• Sequentialwrite(Ops/s–Writewillmore)

• Datanotinextentcache(Ops/s–Readwillmore)

134

Sometimesyouneedcheckbackenddiskresponsetime

Slowdiskresponse

135

CheckallvDiskLatencyRange

• Ifyourresponsetimeisbetween2~20ms,justlikeatraditionalstorage

• Ifyourresponsetimeismorethan50ms,customershouldbefeltslowresponseinapp

• Weshouldbekeeptheapplicationbelow1ms,thenyourcustomerwillbeveryhappy

136

ChecktheaveragelatencyforavDisk

Mostoftime,thisshouldbenearFrontEndwritelatency

Ifyoufindthisnotmatchtofrontendwritelatency,youshouldcallsupporttocheck

137

Checkwherethedataislocate

BestCaseshouldbefromthis

138

OraclePerformance&Troubleshooting(cont’d)

qAWRReports

o Showsperformancedatacapturedbetweentwosnapshots

o Reportsaveragesstatisticsoverthetimeperiodbeinganalyzed

o Defaultsnapshotsarehourly

o Forperformancetroubleshooting,snapshotshouldbearound15minutesto30

minutesduringpeaktimeortroubletime

o Musthaveabaselinetocompareagainst

o Fortransactionaldatabase,latencyisthemostimportantfactor

o Foranalyticaldatabase,throughputisthemostimportantfactor

139

OraclePerformance&Troubleshooting(cont’d)

q AnalyzingAWRReports

o Thingstolookfor

140

OraclePerformance&Troubleshooting(cont’d)

q AverageActiveSessions

o ThenumberofconcurrentsessionsthataredoingSQLor

PL/SQLstatements

o Thiswillgiveagoodindicationofhowbusythedatabase

isduringthatsnapshotperiod

o AAS=DBtime/ElapsedTime

o 160/5=32activesessions

o 24000/120=200activesessions

141

OraclePerformance&Troubleshooting(cont’d)

q LoadProfileSection

o Thissectiongivesanindicationoftheredosize(inbytes)

duringthesnapshotperiod.

o TheRedoSizeshowshowmuchredohasbeengenerated.

o Transactionsshowshowmanytransactionspersecond

thedatabasehasgeneratedduringthesnapshotperiod.

142

OraclePerformance&Troubleshooting(cont’d)

q IOProfileSection

o ThissectiongivesanindicationofthephysicalIORequest

o TotalPhysicalIOs=50199.6

o PhysicalRead%=38443.9/50199.6*100=76.6%

o PhysicalWrite%=11755.7/50199.6*100=23.4%

143

OraclePerformance&Troubleshooting(cont’d)

q ForegroundWaitClassSection

• Lookforthe“UserI/O”and“SystemI/O”waitclassandthe%valueinthe“%DBtime”column.Thisis

the%ofDBtimethatwasspentwaitingonI/O.Alsolookatthe“Avgwait(ms)”columnforthosewait

classes.

• UserI/OWaitWaitsforuserI/O(ex:‘dbfilesequentialread’)

• SystemI/OWait–WaitsforbackgroundprocessI/O(ex:DBWRwaitfor‘dbfileparallelwrite’)

144

OraclePerformance&Troubleshooting(cont’d)

q Top10ForegroundEventsSection

• LookforEventswithhigh%DBTime

• Dbfilesequentialread–RandomI/Osingleblockreadfromdisk(89%DBtime)

• Dbfileparallelread–Happensduringrecoveryorduringbufferprefetchingasanoptimization(8.7%DBtime)

• DBCPU–Oracleserver/foreground/shadowprocessCPUconsumption(3.9%DBtime)

145

OraclePerformance&Troubleshooting(cont’d)

q WaitEventHistogramSection(from<1msto>1s)

• Showsapercentagetrendatdifferentlatencyvalues

• Dbfilesequentialread–RandomI/Osingleblockreadfromdisk

• Dbfilescatteredread–AmultiblockreadfromdiskintotheSGA

• Dbfileparallelread–Happensduringrecoveryorduringbufferprefetchingasanoptimization

• Dbfileparallelwrite–DBWRperformsaparallelwritetofiles

• Directpathwrite–AprocessiswritingbuffersdirectlyfromPGAtodisk

146

OraclePerformance&Troubleshooting(cont’d)

q WaitEventHistogramSection(from<32msto>=2s)

147

OracleLicense&Support

148

OracleLicenseModel

• NamedUserPlus

- StandardEditionOnerequiresaminimumof5NamedUserorthetotalnumberofactual

users,whicheverisgreater

- StandardEditionrequiresaminimumof5NamedUserorthetotalnumberofactualusers,

whicheverisgreater

- TheEnterpriseEditionrequiresaminimumof25NamedUserPlusperProcessorlicensesor

thetotalnumberofactualusers,whicheverisgreater

• Processor–Wewillintroductioninfollowingslide

• OraclelicenseswithHardandSoftpartitioningofphysicalsystems

- Hard=“fixed”–allowssubsystemlicensing(Oracle)

- Soft=“fluid”–requiresfullsystemlicensing(Virtualization)

- OraclecountsVMwareasasoft partition technology

- Mustlicense“entireserver”

149

Hard&Softpartition

Hardpartition(UsuallyonHPUX/AIX/Solaris/OracleVM) Softpartition(UsuallyonVMware,HyperV,*OracleVM)

Youjustneedtopayfor4coreslicense

Onenodewith8cores Onenodewith8cores

Youjustneedtopayfor8coreslicense

Using

4vCPU

Using

4vCPU

150

CoreFactorTable

– http://www.oracle.com/us/corporate/contracts/processor-core-factor-table-

070634.pdf

151

OracleDatabaseLicensing–

CPUBasedSKUConsiderations

StandardEditionTwo

Licensedbysocket

Limitedtotwo sockets

Mustlicensefullmachine

StandardEdition

Licensedbysocket

Limitedtofour sockets

Mustlicensefullmachine(s)

EnterpriseEdition

Licensedbycore

Applyx86factorof0.5tocores

Mustlicensefullmachine

Ex:3360G4,E52630v3(16core)

5.8Kx2socketx3

hosts=34.8K

17.5Kx2socketx3

hosts=105K

47.5Kx16corex3

hostsx0.5corefactor

=1140K

Oraclehave“NumberofUserlicense“wedonotintroducehere,onecorelicenseabout25nameusers

http://www.oracle.com/us/corporate/pricing/technologypricelist070617.pdf(OraclePriceBook)

152

OracleLicenseonVirtualization

(Oracle)

vMotion vMotion

• Oracletreatvirtualizationassoftpartition,weneedentitleallthelicenseofphysicalbox

• VMcanvMotionbetweenourNutanixCluster,soweneedentitleallthecluster

• UsingDRSaffinitytolimitVMvMotionhosts,thatcansaveforOraclelicense

Thoselogs(/var/log/vmware/hostd.log,/vmfs/volumes/datastore/vm/vmware.log)providevMotionandprove

VMrunningonwhichhosts

• Whenentitleallboxorcluster,youcanrunasmuchVM(Oracle)asyoucan

153

Choosethefewercoresforsavinglicense

• ChoosefewercoresmodelCPUwhenpurchase

• CheckifeveryOracleDBneeduseEEedition?DoespossibletoswitchtoSTDEdition?

154

SavingOracleLicense(DRS)

• Ifyouhave8nodesNutanixcluster,6nodeswerunVDIsolutionandwejusthavetwonodesthatrunning

OracledatabaseguestVM.Wejustneedpayfortwonodeslicensefee.

• Inthistwonodes,youcanrununlimitedOracledatabaseguestVM

(Oracle)

Oracleusednodes

VDInodes

NutanixCluster

155

SavingOracleLicense(DifferentESXiClusterbutsame

NutanixNDFS)

ESXiCluster1(forApplications) ESXiCluster2(Oracle)

AHVwillsuggestusedifferentclusterbydatabase

156

SavingOracleLicenseDesign

NX8235G4or

NX3260G4

NX6235C

Oneclustercomposebyfournodes

TwoareComputeNodes,theothertwoareStorageNodes

SowejustpayforthetwoComputeNodeslicenses,because

OracleGuestVMneverrunningonStorageNodes.

(Oracle)

157

Maintainsamelicensecostasbefore

Volume Group

Non-disruptive upgrades &

fast fail-over in seconds

I/O load balanced across all nodes

(including new node)

Single-step discovery via data

services IP

New Node

Nutanixjustasastorage

158

Youcandesignlikethis

(Oracle)

(APP)

(Oracle)

(APP)

(Oracle)

(APP)

DedicateforABS

iSCSI

NFS

159

OracleLicensing

160

MarsvsOracle

http://houseofbrick.com/marsvsoracle/

TheMartian’sresponse

161

Oracle support ESXi Document – 249212.1

IfaproblemisaknownOracleissue,Oraclesupport

willrecommendtheappropriatesoutiononthenativeOS.

IfthatsolutiondoesnotworkintheVMwarevirtualized

Environment,thecustomerwillbereferredtoVMware

Forsupport.Whenthecustomercandemonstratethatthe

Oraclesolutiondoesnotworkwhenrunningonthe

nativeOS,Oraclewillresumesupport,includinglogginga

BugwithOracleDevelopmentforinvestigationifrequired.

162

Nutanix TSANET support

https://www.tsanet.org/blog/2015/7/7/tsanet-member-spotlight-%E2%80%93-

nutanix

163

Oracle on AHV support

https://portal.nutanix.com/#page/kbs/details?targetId=kA032000000TTtJCAW

Thank You

165

WhereshouldIgetdiscount?

• Thisisarealcase–

• Oraclealreadyassume50%discount

• WecanseeOracletake60%

ofallprojectbudget

• VMwareget23%ofwholeproject

• Nutanixjust17%inwholeproject

• IfwegetmorediscountfromOracle

Wecansave$$

• WealsocaneliminateESXilicence

FeebyusingAHV

166

Ifmydatabasedatamorethanonenode?

First–Ihavetosay,youdidthewrongsizing

Nutanixstillcanfixthisissue

167

NutanixClone

168

NutanixSnapshot

169

CompressioninContainerLevel

Thiswillalsoincreasetheusable

sizeoftheSSDtierincreasing

effectiveperformanceand

allowingmoredatatosit

intheSSDtier.

170

NutanixDataProtection

• Advantage

• Simple

• CansetupmultipleOracleserversbackupinonegroup,donotneedextra

configuration

• CanputallDB,RelatedAppServerinsameprotectiondomain

• CanintegratedwithVSSifguestOSisWindows

• Disadvantage

• JustrecovertoPIT

• Every60minutesinterval–RPOtoolongforadatabase